Serveur d'exploration sur la recherche en informatique en Lorraine

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Managing large-scale, distributed systems research experiments with control-flows

Identifieur interne : 000092 ( Main/Exploration ); précédent : 000091; suivant : 000093

Managing large-scale, distributed systems research experiments with control-flows

Auteurs : Tomasz Buchert [France]

Source :

RBID : Hal:tel-01273964

Descripteurs français

English descriptors

Abstract

Running experiments on modern systems such as supercomputers, cloudinfrastructures or P2P networks became very complex, both technicallyand methodologically. It proved difficult to run experiments correctlyand understand obtained results, even with the background on theemployed technology and methods. Moreover, large-scale experimentssuffer from erroneous and the unpredictable behavior of underlyingsoftware and hardware, undermining the scientific principles ofexperimental computer science. This worrisome state of research onlarge-scale distributed systems calls for new approaches to design,run and interpret experiments.This work explores the use of control-flows (business processes) as amodel for representing the large-scale experiments in research ondistributed systems. We set out to find advantages, disadvantages andlimitations of this approach, and practical considerations for futureimplementers.We make 3 main contributions. First, we analyze the current state ofexperiment management tools, their limits and features to betterunderstand difficulties that lay ahead. We construct a generalframework to evaluate tools of this type. Second, we design andimplement an experiment management tool which is based on the model ofcontrol-flows. We show that this methodology can be implemented andused in practice to run challenging and large-scale experiments whileoffering a wide set of features, some of them missing in the previousapproaches. Finally, we analyze the use of provenance in computerscience, and in particular in experimental research on distributedsystems, and propose a provenance collection system that emerges fromthe control-flow model used as the representation of experiments. Thedesign is implemented and shown to collect provenance in efficient andautomatic way.Our results show that workflows are a viable model for the design andexecution of experiments in distributed systems research. With thesepositive conclusions in mind, we also sketch future researchdirections for improving our work.

Url:


Affiliations:


Links toward previous steps (curation, corpus...)


Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Managing large-scale, distributed systems research experiments with control-flows</title>
<title xml:lang="fr">Gestion d'expériences à grande échelle dans la recherche sur les systèmes distribués à l'aide de control-flows</title>
<author>
<name sortKey="Buchert, Tomasz" sort="Buchert, Tomasz" uniqKey="Buchert T" first="Tomasz" last="Buchert">Tomasz Buchert</name>
<affiliation wicri:level="1">
<hal:affiliation type="researchteam" xml:id="struct-205122" status="VALID">
<idno type="RNSR">200418297A</idno>
<orgName>Management of dynamic networks and services</orgName>
<orgName type="acronym">MADYNES</orgName>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/madynes</ref>
</desc>
<listRelation>
<relation active="#struct-129671" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-423085" type="direct"></relation>
<relation active="#struct-206040" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
<tutelles>
<tutelle active="#struct-129671" type="direct">
<org type="laboratory" xml:id="struct-129671" status="VALID">
<idno type="RNSR">198618246Y</idno>
<orgName>INRIA Nancy - Grand Est</orgName>
<desc>
<address>
<addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/nancy</ref>
</desc>
<listRelation>
<relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect">
<org type="institution" xml:id="struct-300009" status="VALID">
<orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc>
<address>
<addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-423085" type="direct">
<org type="department" xml:id="struct-423085" status="VALID">
<orgName>Department of Networks, Systems and Services</orgName>
<orgName type="acronym">LORIA - NSS</orgName>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr/la-recherche-en/departements/networks-systems-and-services</ref>
</desc>
<listRelation>
<relation active="#struct-206040" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-206040" type="indirect">
<org type="laboratory" xml:id="struct-206040" status="VALID">
<idno type="IdRef">067077927</idno>
<idno type="RNSR">198912571S</idno>
<idno type="IdUnivLorraine">[UL]RSI--</idno>
<orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<date type="start">2012-01-01</date>
<desc>
<address>
<addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation>
<relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-413289" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-413289" type="indirect">
<org type="institution" xml:id="struct-413289" status="VALID">
<idno type="IdRef">157040569</idno>
<idno type="IdUnivLorraine">[UL]100--</idno>
<orgName>Université de Lorraine</orgName>
<orgName type="acronym">UL</orgName>
<date type="start">2012-01-01</date>
<desc>
<address>
<addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.univ-lorraine.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect">
<org type="institution" xml:id="struct-441569" status="VALID">
<idno type="ISNI">0000000122597504</idno>
<idno type="IdRef">02636817X</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName>
<settlement type="city">Nancy</settlement>
<settlement type="city">Metz</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université de Lorraine</orgName>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">HAL</idno>
<idno type="RBID">Hal:tel-01273964</idno>
<idno type="halId">tel-01273964</idno>
<idno type="halUri">https://tel.archives-ouvertes.fr/tel-01273964</idno>
<idno type="url">https://tel.archives-ouvertes.fr/tel-01273964</idno>
<date when="2016-01-06">2016-01-06</date>
<idno type="wicri:Area/Hal/Corpus">003078</idno>
<idno type="wicri:Area/Hal/Curation">003078</idno>
<idno type="wicri:Area/Hal/Checkpoint">000094</idno>
<idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000094</idno>
<idno type="wicri:Area/Main/Merge">000092</idno>
<idno type="wicri:Area/Main/Curation">000092</idno>
<idno type="wicri:Area/Main/Exploration">000092</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en">Managing large-scale, distributed systems research experiments with control-flows</title>
<title xml:lang="fr">Gestion d'expériences à grande échelle dans la recherche sur les systèmes distribués à l'aide de control-flows</title>
<author>
<name sortKey="Buchert, Tomasz" sort="Buchert, Tomasz" uniqKey="Buchert T" first="Tomasz" last="Buchert">Tomasz Buchert</name>
<affiliation wicri:level="1">
<hal:affiliation type="researchteam" xml:id="struct-205122" status="VALID">
<idno type="RNSR">200418297A</idno>
<orgName>Management of dynamic networks and services</orgName>
<orgName type="acronym">MADYNES</orgName>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/madynes</ref>
</desc>
<listRelation>
<relation active="#struct-129671" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-423085" type="direct"></relation>
<relation active="#struct-206040" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
<tutelles>
<tutelle active="#struct-129671" type="direct">
<org type="laboratory" xml:id="struct-129671" status="VALID">
<idno type="RNSR">198618246Y</idno>
<orgName>INRIA Nancy - Grand Est</orgName>
<desc>
<address>
<addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/nancy</ref>
</desc>
<listRelation>
<relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect">
<org type="institution" xml:id="struct-300009" status="VALID">
<orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc>
<address>
<addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-423085" type="direct">
<org type="department" xml:id="struct-423085" status="VALID">
<orgName>Department of Networks, Systems and Services</orgName>
<orgName type="acronym">LORIA - NSS</orgName>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr/la-recherche-en/departements/networks-systems-and-services</ref>
</desc>
<listRelation>
<relation active="#struct-206040" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-206040" type="indirect">
<org type="laboratory" xml:id="struct-206040" status="VALID">
<idno type="IdRef">067077927</idno>
<idno type="RNSR">198912571S</idno>
<idno type="IdUnivLorraine">[UL]RSI--</idno>
<orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<date type="start">2012-01-01</date>
<desc>
<address>
<addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation>
<relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-413289" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-413289" type="indirect">
<org type="institution" xml:id="struct-413289" status="VALID">
<idno type="IdRef">157040569</idno>
<idno type="IdUnivLorraine">[UL]100--</idno>
<orgName>Université de Lorraine</orgName>
<orgName type="acronym">UL</orgName>
<date type="start">2012-01-01</date>
<desc>
<address>
<addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.univ-lorraine.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect">
<org type="institution" xml:id="struct-441569" status="VALID">
<idno type="ISNI">0000000122597504</idno>
<idno type="IdRef">02636817X</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc>
<address>
<country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName>
<settlement type="city">Nancy</settlement>
<settlement type="city">Metz</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université de Lorraine</orgName>
</affiliation>
</author>
</analytic>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass>
<keywords scheme="mix" xml:lang="en">
<term>business processes</term>
<term>distributed systems</term>
<term>experiment control</term>
<term>experiment provenance</term>
<term>large-scale experiments</term>
</keywords>
<keywords scheme="mix" xml:lang="fr">
<term>control-flows</term>
<term>démarche scientifique</term>
<term>grande échelle</term>
<term>processus métier</term>
<term>systèmes distribués</term>
<term>workflows scientifiques</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">Running experiments on modern systems such as supercomputers, cloudinfrastructures or P2P networks became very complex, both technicallyand methodologically. It proved difficult to run experiments correctlyand understand obtained results, even with the background on theemployed technology and methods. Moreover, large-scale experimentssuffer from erroneous and the unpredictable behavior of underlyingsoftware and hardware, undermining the scientific principles ofexperimental computer science. This worrisome state of research onlarge-scale distributed systems calls for new approaches to design,run and interpret experiments.This work explores the use of control-flows (business processes) as amodel for representing the large-scale experiments in research ondistributed systems. We set out to find advantages, disadvantages andlimitations of this approach, and practical considerations for futureimplementers.We make 3 main contributions. First, we analyze the current state ofexperiment management tools, their limits and features to betterunderstand difficulties that lay ahead. We construct a generalframework to evaluate tools of this type. Second, we design andimplement an experiment management tool which is based on the model ofcontrol-flows. We show that this methodology can be implemented andused in practice to run challenging and large-scale experiments whileoffering a wide set of features, some of them missing in the previousapproaches. Finally, we analyze the use of provenance in computerscience, and in particular in experimental research on distributedsystems, and propose a provenance collection system that emerges fromthe control-flow model used as the representation of experiments. Thedesign is implemented and shown to collect provenance in efficient andautomatic way.Our results show that workflows are a viable model for the design andexecution of experiments in distributed systems research. With thesepositive conclusions in mind, we also sketch future researchdirections for improving our work.</div>
</front>
</TEI>
<affiliations>
<list>
<country>
<li>France</li>
</country>
<region>
<li>Grand Est</li>
<li>Lorraine (région)</li>
</region>
<settlement>
<li>Metz</li>
<li>Nancy</li>
</settlement>
<orgName>
<li>Université de Lorraine</li>
</orgName>
</list>
<tree>
<country name="France">
<region name="Grand Est">
<name sortKey="Buchert, Tomasz" sort="Buchert, Tomasz" uniqKey="Buchert T" first="Tomasz" last="Buchert">Tomasz Buchert</name>
</region>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000092 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000092 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Lorraine
   |area=    InforLorV4
   |flux=    Main
   |étape=   Exploration
   |type=    RBID
   |clé=     Hal:tel-01273964
   |texte=   Managing large-scale, distributed systems research experiments with control-flows
}}

Wicri

This area was generated with Dilib version V0.6.33.
Data generation: Mon Jun 10 21:56:28 2019. Site generation: Fri Feb 25 15:29:27 2022